Uncertainty Quantification for MLP-Mixer Using Bayesian Deep Learning
نویسندگان
چکیده
Convolutional neural networks (CNNs) have become a popular choice for various image classification applications. However, the multi-layer perceptron mixer (MLP-Mixer) architecture has been proposed as promising alternative, particularly large datasets. Despite its advantages in handling datasets and models, MLP-Mixer models limitations when dealing with small This study aimed to quantify evaluate uncertainty associated using Bayesian deep learning (BDL) methods compare results existing CNN models. In particular, we examined use of variational inference Monte Carlo dropout methods. The indicated that BDL can improve performance by 9.2 17.4% term accuracy across different On other hand, suggest tend limited improvement or even decreased some cases BDL. These findings is approach especially
منابع مشابه
Bayesian Solution Uncertainty Quantification for Differential Equations
We explore probability modelling of discretization uncertainty for system states defined implicitly by ordinary or partial differential equations. Accounting for this uncertainty can avoid posterior under-coverage when likelihoods are constructed from a coarsely discretized approximation to system equations. A formalism is proposed for inferring a fixed but a priori unknown model trajectory thr...
متن کاملDeep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantification
State-of-the-art computer codes for simulating real physical systems are often characterized by vast number of input parameters. Performing uncertainty quantification (UQ) tasks with Monte Carlo (MC) methods is almost always infeasible because of the need to perform hundreds of thousands or even millions of forward model evaluations in order to obtain convergent statistics. One, thus, tries to ...
متن کاملBayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification
We are interested in the development of surrogate models for uncertainty quantification and propagation in problems governed by stochastic PDEs using a deep convolutional encoder-decoder network in a similar fashion to approaches considered in deep learning for image-to-image regression tasks. Since normal neural networks are data intensive and cannot provide predictive uncertainty, we propose ...
متن کاملBayesian Compression for Deep Learning
Compression and computational efficiency in deep learning have become a problem of great significance. In this work, we argue that the most principled and effective way to attack this problem is by taking a Bayesian point of view, where through sparsity inducing priors we prune large parts of the network. We introduce two novelties in this paper: 1) we use hierarchical priors to prune nodes ins...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied sciences
سال: 2023
ISSN: ['2076-3417']
DOI: https://doi.org/10.3390/app13074547